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Abstract. We give an exact solution to the nonlinear optimization 
problem of approximating a Hermitian matrix by positive semi-definite 
matrices. Our algorithm was then used to judge whether a quantum 
state is entangled or not. We show that the exact approximation of a 
density matrices by tensor product of positive semi-definite operators is 
determined by the additivity property of the density matrix. 



1. Introduction 

Quantum entanglement is one of the most interesting features in quan- 
tum computation [20j [23] as it is vital for quantum dense coding, quantum 
error-correcting codes, teleportation and also responsible for fast quantum 
algorithms. Much efforts have been made to find criteria for quantum sep- 
arability: the Bell inequalities [3J, PPT (positive partial transposition) [23] , 
reduction criterion [5j [12], majorization criterion |22| . entanglement wit- 
nesses |16[ [26j [19] , realignment [241 16] and generalized realignment methods 
PQ. Nevertheless the problem is still not fully solved except for lower rank 
cases PUSH]. 

In [8] we proposed a new method to judge if a density matrix is separable. 
We first decompose the density matrix as a tensor product of hermitian 
matrices, and then we reduce the separability problem to that of finding 
when the hermitian matrix becomes positive semi-definite. The strategy was 
to solve the separability by two steps: first one finds a tensor decomposition 
of the density matrix by hermitian matrices, and then one approximates the 
hermitian matrices by positive semi-definite matrices if possible. Although it 
was proved that a density matrix is separable if and only if the separability 
indicator is non-negative, it is highly nontrivial to actually compute this 
indicator. In this sense the method is also similar to many of its predecessors. 

In the current paper we approach the question from a new angle by giving 
an algorithm to compute the closest positive semi-definite matrix to any 
given hermitian matrix. It is noted that this optimization is not a linear 
problem so the usual QR decomposition in [15] does not work. By general 
theory of convex sets the existence of the minimum is guaranteed but it is 
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nontrivial to find the exact solution due to the nonlinearity. In this paper we 
first solve this optimization problem exactly using matrix theory. This paves 
the way for us to attack the main problem of separability by directly looking 
for an optimal approximation to a sum of matrices by positive semi-definite 
matrices. 

It turns out that the exact solution in the most important case can be 
solved by Lie theoretic techniques. First we show that a Hermitian matrix 
with two commuting summands can be approximated term by term. Next 
we prove that if the summands of a Hermitian matrix can be simultaneously 
made to upper triangular matrices, then the exact approximation by positive 
semi-definite matrix can be done term by term. Our method provides a 
direct way to approximate the hermitian matrix by positive semi-definite 
matrices and thus the separability problem can be solved theoretically in 
this sense. 

It is interesting to note that similar (but stronger constrained) matrix 
approximation also appears in finance, image processing, date mining, and 
other areas such as resource allocation and industrial process monitoring 
[25\ [28| 0]. Most methods used in these problems are numerical algorithms 
that only give an approximation to the solution. In some sense our results 
also provide the first exact and analytical method in this direction, and we 
also hope that conversely some of the numerical algorithms may be useful 
in quantum entanglements. 

2. Approximation by Positive Definite Matrices 

Let A be an n x n Hermitian matrix, and let Q be a unitary matrix 
such that A = QDQ^, where D = diag(a\, ■ ■ ■ ,a n ) and | is conjugation 
and transposition. The signature (p, q) of A (cf. [18]) is defined by p + 
q = rank(A). We can permute the columns of the matrix Q so that the 
eigenvalues of A are arranged in the following order: 

a\ > ■ ■ ■ > a p > > a p+ i >■■■> a p+q , a p+q+ i = ■ ■ ■ = a n = 0. 

We further define 

(1) A = A + -A_, 

where A± = QD±Q^ , and 

D + = diag(ai, • • • , a p , 0, • • • ,0) 

D- = diag(0, ■■■ ,0, -a p+ i, • • • , -a p+q , 0, • • • ,0) 

formed by positive (negative) eigenvalues respectively. We remark that our 
definition of the positive and negative semi-definite parts of A is independent 
from our choice of Q. In general, if A is diagonalized by a unitary matrix Q 
as follows: 

A = QDQ^ = Qdiag(a\, ■ ■ ■ ,a n )Q\ 
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then we have 



A± = Qdiag(a 



••• ,<)Q 
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It is clear that A is positive semi-definite if and only all eigenvalues of A 
are non-negative. Therefore both A± are positive semi-definite matrices. It 
is easy to see that the decomposition ([I]) of A into a difference of positive 
semi-definite matrices is unique up to positive definite matrices, i.e., if A = 
A' + — A'_, where A'± are positive semi-definite, then A± = A'± + P with a 
positive semi-definite matrix P. 

If A and B are commuting positive semi-definite matrices, so is their 
product. If they are not commutative, then AB is in general not a positive 
semi-definite matrix, as AB may not even be hermitian. 

Lemma 2.1. Let A and B be positive semi-definite Hermitian matrices, 
then the eigenvalues of AB are all non-negative. 

Proof. If A is invertible, and let A be an eigenvalue of AB, then for some 
vector i / 0, 

ABx = Ax. 

Hence Bx = \A~ 1 x. Note that both A~ 1 and B are positive, so 

x 1 Bx = Xx^A~ x x > 0, 

Subsequently A > 0. In general, if A is singular, then for any e > the 
matrix A + el is positive definite. Therefore any eigenvalue A = A(e) of 
(A + eI)B is positive. Letting e — > 0, we see that Um e ^oX > 0, i.e. any 
eigenvalue of AB is non-negative. □ 

For any matrix A, the Frobenius norm is defined to be ||^4||f = (tr(AA^)) 1 ^ 2 , 
which is also equal to the sum of squares of singular values of A. 

Theorem 2.2. Let A be an n x n hermitian matrix, then for any positive 
semi-definite matrix B we have 



with equality when B = A + . i.e. the closest positive semi-definite matrix to 
A is given by A + . 

Proof. Omitting the subscript in the Frobenius norm, we have for any pos- 
itive semi-definite matrix B 



\\A - B\\ 2 = tr(A - Bf = tr(A 2 ) - 2tr(AB) + tr(B 2 ) 
= tr(A 2 ) + 2tr(A^B) + tr(B 2 ) - 2tr(A + B) 
= tr(A 2 ) + 2tr(A_B) + tr(B - A + ) 2 - tr(A 2 + ) 

by using tr(AB) = tr(BA) and completing square. Since B and A± are pos- 
itive semi-definite, then tr(A_B) > for any B by Lemma 12.11 Therefore, 



(2) 



A - B\\ F > \\A_\\ F 
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it follows that for any positive semi-definite matrix B 

\\A - B\\ 2 > tr(A 2 ) + tr{B - A + f - tr(A 2 + ) 
= \\Af - \\A + f + \\B -A + \\ 2 
> \\A\\ 2 - \\A + \\ 2 

where the equality is obtained when B = A + . □ 

We remark that similar (Toeplitz and/or correlation matrix) approxima- 
tion with stronger constraints has been studied in finance and image process- 
ing [25], EE] • O ur result is more general and stronger in the sense that we do 
not require that the matrix to be either Toeplitz or correlation matrix (real 
positive definite with unit diagonal). Furthermore our result is analytical 
and exact, as no numerical approximation is needed for the solution. 

Corollary 2.3. Let A and B be any two Hermitian matrices, then for any 
positive semi- definite matrix C of the same size as A® B, we have 

\\A®B- C\\ F > \\{A®B)^\\ F = \\A + &B- + A-® B + \\ F . 

The equality holds when C = {A® B) + = A + ® B + + A^ ® 

Proof. It is enough to show that {A ® B)± = ^ e A e ® B± e , where e = +, — . 
Suppose A and B are diagonalized by Q\ and Q2 respectively: 

A = QiDxQl = Qxdiag(ax,- ■ ■ ,a m )Q[, 

B = Q 2 D 2 Ql = QidiagiPx,- ■ ■ ,p n )Q\ 

then we have 

A ® B = (Qi ® Q 2 )(Dx ® D 2 )(Qx ® Q 2 )t 
As the eigenvalues a of A ® B are \i/3j, thus 

Since the zero eigenvalues do not contribute to the decomposition, we have 
that {A®B) + = A + ®B + +A-®B^, and (A®B)^ = A + ®B^+A^®B + □ 

3. Sums of matrices and estimates 

It appears that the decomposition of the Hermitian matrix A into a sum 
of two Hermitian matrices B,C has a close relationship to our problem. 
This problem has a much longer history in mathematics. 

Horn defines the following concept for the Hermitian matrices. Let A 
and B be two nxn matrices with eigenvalues cti and fy. For any subset / we 
denote \I\ = Y^iei The se t °f triples (I, J, K) of subsets of {1, ... , n} 
of the same cardinality r is defined by first setting 

V? = {(I, J, K)\\I\ + I J| = \K\ + r(r + l)/2}, 
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then define T" = £7f and in general 

T™ = {(/, J, K) G U?\ for all p < r and all (F, G, H) € U£ 

/eF 9 gg hei? 

The following characterization of eigenvalues a, /3, 7 of C = A + B is 
proved in [9]. 

Theorem 3.1. (Tlorn's conjecture^ ^4 triple (a,(3,j) occurs as eigen- 
values of A,B,C such that C = A + B if and only if \a\ + = \^\ and 
inequalities 

keK iei jeJ 
hold for all triple (I, J, K) in T" for all r < n. 

The special case of r = 1 is Weyl's inequality: 

Ji+j-i <»i + (3j 
Since I7I = \a\ + |/3|, we also have 

A practical bound is the following: 

Max ai + (3j < 7^ < Min o-j + 

i+j=n+k i+j=k+l 

Apply these results to our situation, we then get the following: 

Theorem 3.2. Let A be a density matrix over the Hilbert space H = T-L\ <8> 
V.2- Suppose A = Bi® Ci, then we have 

\\A - A+Wf < J2 \\Bi ~ (B l )+\\ -\\Ci- (a)+|| 

i 

4. Lie Algebras and Approximation of Summations 

As the Hermitian decomposition of the density matrix A is a summation, 
one hopes to check its separability by demonstrating that each summand 
can be expressed by tensor products of positive semi-definite matrices. 

The main problem is to estimate the error given by term by term approx- 
imation. Suppose that A and B are two Hermitian matrices we would like 
to estimate the norm ||^4 + B — A + — B+\\. 

Lemma 4.1. Let A and B are two commuting Hermitian matrices, then 



{A + B)+ <A + + B + 
(A + B)- <A_+B- 
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Proof. Since A and B are commuting, they can be diagonalized simultane- 
ously by a unitary matrix Q. In other words we have 

A = QD A Q^ = A + -A_= Q(D A ) + Q^ - Q{D A )_Q^ 
B = QD B Q^ = B+-B_ = Q(D b ) + Q^ - Q(Db)~Q J[ 

thus, 

A + B = Q{D A + Q B )Q^ 

= Q((D A ) + + (D B ) + )Q^ - Q((D A )_ + (D B )^)Q\ 

which implies that (^4 + B) + = A + + B + and (A + B)_ = A- + B . □ 

Theorem 4.2. Let Ai (resp. Bi) be set of commuting positive semi- definite 
Hermitian matrices of the same size, then for any positive definite matrix 
C of the same size as Ai Bi we have 

|| J2 A i ® B i - °Wf > II S {(Ai)+ ® + (^)- ® (S<)+} ||f, 

where the equality holds when 

C = ® 5,)+ = ^ ® + (Ai)_ ® (Bi)-} . 

i i 

We remark that the condition that A and B are commuting with each 
other is also necessary for the equality in the theorem to hold. The following 
result is quoted from standard books on Lie algebras [TO] . 

Proposition 4.3. (Lie's theorem) Let L be any solvable subalgebra of the 
general linear Lie algebra, then the matrices of L relative to a suitable basis 
of V are upper triangular. Furthermore, one can adjust the basis to be 
orthonormal. 

We remark that the last statement is due to the fact that the transi- 
tion matrix in Gram-Schmidt process is upper triangular. Now we suppose 
that there exists a unitary matrix Q such that both A and B are upper- 
triangular ized as follows: 

A = QK 1 Q\B = QK 2 Q\ 

where Aj are upper-triangular. If A and B are hermitian, then A| = Aj, 
which forces Aj to be diagonal. Then A and B are actually commuting 
with each other, subsequently (A + B)± = A± + B±. So in this context the 
additivity seems to be not too far away from commutativity. 

Theorem 14.21 gives the closest approximation to a two-partite density op- 
erator by the tensor operator of non-negative operators, however one has 
to fit the approximation under the constraint of unit trace. We hope that 
further studies can answer this question. 
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5. Conclusion 

Matrix approximation is an old problem in mathematics with applica- 
tions in physics, finance, and computer sciences. In this paper we have 
completely solved the optimization problem to approximate any Hermitian 
matrix by positive semi-definite matrices. The solution is shown to be given 
by the spectral decomposition of the concerned matrix. We apply this result 
to density matrices and obtain useful approximation by tensor product of 
density matrices using Lie theoretic techniques. Our results also open possi- 
ble deep connection among quantum entanglement, data mining and signal 
procession. 
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